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1 "Method of detecting flicker, and video camera using 

2 the Method" 
3 

4 This invention relates to a method of detecting 

5 lighting-induced flicker in a video signal, and to a 

6 video camera equipped for carrying out this method. 

7 - - 

8 Artificial lighting derived from alternating-current 

9 sources, particularly fluorescent lighting, contains 

10 ' a strong brightness modulation component, or flicker, 

11 kt twice the mains frequency, this factor of 2 

12 arising from the power-relation between instantaneous 

13 mains voltage and instantaneous brightness, and from 

14 the trigonometric relation cos 2 (x) = - 0 . 5 {1 + cos (2x) ) . 

15 . Commonly encountered flicker frequencies are 10 0Hz in 

16 Europe and 12 0Hz in USA. Although invisible to the 

17 human eye, flicker may be highly visible to image 

18 sensors. The problem is most apparent at low 

19 exposure values; in the limit, short -time pixel 

20 exposure samples this modulation waveform as 



2 

1 reflected from objects in the scene and reproduces it 

2 perfectly. 
3 

4 Solid-state sensors fall into two broad categories 

5 according to exposure method; full-field, where all 

6 pixel elements of the sensor are exposed 

7 simultaneously, and rolling window, where all pixel 

8 elements in a sensor row are exposed simultaneously, 

9 but the onset of exposure is delayed from row to row. 

10 Lighting flicker induces a cyclical variation in 

11 luminance, known as 'banding' ; apparent in the time 

12 domain, and, in the case of rolling-window sensors, 

13 also in the vertical spatial domain. 
14 

15 In the case of the rolling-window sensors, should the 

16 camera and mains be in perfect synchronisation, the 

17 modulation pattern will be temporally frozen, 

18 appearing as static luminance banding down the image. 

19 However the problem is compounded if camera field 
2 0 rates and mains frequency differ by some amount, 

21 causing the luminance modulation bands to roll up or 

22 down the image. The rate of roll depends mostly on 

23 whether the camera is operating home or away, i.e. 

24 nominal frame rate is a close sub-multiple of mains 

25 frequency or not. For example, a 50Hz camera 
2 6 operating in the USA is operating away. Roll 

27 associated with a camera operating at home is 

28 extremely slow, while roll associated with a camera 
2 9 operating away is much faster. 

30 
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1 As well as being visibly distracting to the viewer, 

2 luminance modulation generates considerable frame-to- 

3 frame differences in image streams which could, for 

4 example, make the difference between a software video 

5 CODEC performing acceptably or not . Thus it is 

6 important that a camera system be capable of 

7 detecting and cancelling artificial lighting flicker. 
8 

9 Detection of lighting flicker in the spatial domain 

10 is difficult in the case of rolling -window exposure 

11 sensors, and impossible in the case of full-field 

12 exposure sensors. In the former case the difficulty 

13 is due to potential strong correlations between 

14 expected banding patterns caused by lighting flicker 

15 and variations in actual scene luminance. 
16 

17 One object of the present invention is to provide a 

18 time-domain technique for detecting and identifying 

19 the frequency of flicker, and which is capable of 

20 being applied to both full -field exposure sensors and 

21 rolling- window exposure sensors. 
22 

23 US Patent 5053871 discloses a still video camera 

24 which uses a previewing technique to provide 

25 automatic exposure control and flicker detection. 

2 6 The present invention relates to motion video cameras 

2 7 and a concurrent detection technique. US Patent 

28 5272539 discloses a video camera with flicker 

2 9 detection, but in this prior arrangement the detector 

3 0 frame rate is coupled with the video frame rate, 
31 which limits its usefulness. The invention in its 
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1 various aspects is defined in the claims appended 

2 hereto. 
3 

4 An embodiment of the invention will now be described, 

5 by way of example only, with reference to the 

6 drawings, in which: 
7 

8 Fig.l is a schematic representation of a 

9 photosensitive array used in one form of the present 
10 invention; 

11 

12 Fig. 2 illustrates a sampling method used in this 

13 embodiment; 
14 

15 Fig. 3 is a block diagram of the flicker detection 

16 method of this embodiment; and 
17 

18 Fig. 4 is a block diagram showing use of the method in 

19 a video camera. 
20 

21 Referring to Fig.l, a photosensitive array comprises 

22 an array of pixels 10. It will be appreciated that 

23 Fig.l is highly schematic, with only a small number 

24 of pixels 10 being shown. Additionally, the array 
2 5 comprises one or more (in this embodiment,, two) 

26 super-pixels 12 and 14. Each of the super-pixels 

27 12,14 differs from the pixels 10 of the main array in 

28 two principal ways: 
29 

30 The super-pixel 12,14 is physically large in 

31 comparison to the pixels 10 of the main array, in 
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1 order to stand a better chance of imaging some part 

2 of the scene which contains a flickering light source 

3 or reflects such a flickering source. In this 

4 example, each super-pixel is one entire column of 

5 photosensitive pixel elements 10 which have been 

6 electrically commoned. 
7 

8 The super-pixel 12,14 is exposed and sensed in a 

9 manner independent from the pixels 10 of the main 

10 array. While each line of the main array is sensed 

11 at the frame rate dictated by the application, the 

12 super-pixel is sensed independently, usually at a 

13 rate much higher than the sensor frame rate, in order 

14 to produce a suitable sequence of readings in each 

15 period of the lighting flicker. A convenient rate at 

16 which to sense the super-pixel is t^Te line-rate of 

17 the application, usually some hundreds of times 

18 faster than the frame-rate. 
19 

2 0 Separate means must be provided to control the gain 

21 of the super-pixel, to ensure its output sample falls 

22 within its linear operating range while maximising 

2 3 dynami c range . 
24 

25 The super-pixels may be provided by commoning a 

26 column of standard size pixels, as indicated at 20 in 

27 Fig.l. 
28 

29 The output of the super-pixel (s) is then operated on 

3 0 by a detection mechanism which will now be described 
31 with reference to Figs . 2 and 3. The following 



description refers to the use of a single super- 
pixel. The detection mechanism operates ad infinitum 
on successive length-N sequences f (n) of compound 
samples, each compound sample comprising one or more 
accumulated individual samples s(a) of the super- 
pixel. Each compound sample is spaced apart by an 
appropriate interval I, and we refer to interval I as 
the compound sampling- interval. The individual 
super-pixel samples s (a) are accumulated over a fixed 
number of lines A, less than or equal to interval I 
and referred to as the compound sampling aperture. 
Such accumulation allows an ensemble reduction of 
random components contained in each super-pixel 
reading s(a) at the expense of amplitude reduction of 
the super-pixel signal at the frequencies of 
interest, attributable to the roll-off effect of 
sampling aperture: 

, A 

f(n)4E s ( a ) 

a = 1 

Note that in the cases where the desired compound 
sampling interval I cannot be expressed as an integer 
multiple of the sensor line -interval , the compound 
sampling interval can be adjusted on an instantaneous 
basis so as to average -out to the desired interval 
over time. The resultant phase jitter is tolerable, 
as long as the compound sampling aperture remains 
constant. Figure 2 illustrates the composition of 
the sequence f (n) for N=3 . 
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1 One example of a detection mechanism takes the form 

2 of a bandpass filter, tuned to the nominal frequency 

3 of flicker. If the compound sample -rate of the 

4 super-pixel is chosen as a multiple of the nominal 

5 flicker frequency, a simple detector might use the 

6 fundamental output component F(l) of a radix-N 

7 butterfly, or N-rotor. This circuit performs complex 

8 correlation with the fundamental Nth- root of unity, 

9 to produce the instantaneous measure of complex 
10 flicker energy E: 

H E = F(l) = 2 We N 

12 n = 0 

13 While radix-2 is the simplest butterfly, its response 

14 is phase -dependent and therefore unreliable. As N 

15 increases, so does hardware complexity, and the 

16 smaller the compound sampling interval and potential 

17 aperture. We have found that N=3 or 4 yields the 

18 most efficient and effective solutions. 
19 

2 0 These instantaneous, complex flicker energy readings 

21 E' must be averaged over time in some manner to 

22 produce a longer-term estimate E' of flicker energy. 

23 One example of an averaging mechanism is the first - 

24 order autoregressive filter, or leaky-integrator, 

25 whose ability to track phase drift may be traded 

26 against noise-immunity by means of its system time- 

27 constant /i, updating long-term average E' with 

28 instantaneous measure E: 
29 

30 E' = Efi + E' (1 - fi) 

31 




1 The process of magnitude extraction affords some 

2 protection against phase drift, an inevitable 

3 consequence of short- or long-term differences 

4 between actual and nominal flicker frequencies. The 

5 final flicker detection decision should be based on 

6 the magnitude or modulus of long-term average E' , for 

7 example if T is some programmable or pre-defined 

8 threshold, then the boolean decision variable d can 

9 be defined: 
10 

11 d = |E' I > T 

12 

13 Note that the compound sampling interval may be 

14 chosen so as to undersample the flicker signal, 

15 relying on the folding or aliasing, effect to detect 

16 harmonics of a notional sub-harmonic of flicker. 

17 While this method allows longer exposure times or 

18 compound sampling apertures, it is less able to track 

19 flicker frequencies differing from the nominal, as 
2 0 the error in instantaneous angular frequency is 

21 greater than that of the fundamental case for a given 

22 difference between actual and nominal flicker 

23 frequencies. 
24 

25 Fig. 4 shows the foregoing method used in a flicker- 

26 detecting video camera. 
27 

28 The main sensor array 10' has its exposure setting 

29 controlled by either the output of an automatic 

30 exposure control circuit 18 of known type, or by a 

31 flicker-free exposure setting. The choice between 
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1 these two is controlled by the Boolean operator and 

2 as derived above . 
3 

4 The actual correction of lighting flicker, once 

5 detected and identified in frequency, is 

6 straightforward. 
7 

8 To expand on the sampling analogy, it is well known 

9 that increasing a sampling aperture away from the 

10 therotical perfect sampling (convolution with a 

11 dirac-delta pulse train) causes a roll -off of 

12 frequency response which obeys the equally well-known 

13 sin(x) /x or sine function. If the exposure window is 

14 considered as a sampling aperture, then those 

15 temporal frequencies present in the scene whose 

16 period coincides with the temporal duration of the 

17 exposure window, or harmonics of such frequencies, 

18 will be rendered invisible, as they coincide with 

19 nulls in the sine function. The simple expedient of 

2 0 setting exposure period to the inverse of a suspected 

21 mains flicker frequency or one of its harmonics will 

22 then provide effective banding removal. 
23 

24 A weakness of this scheme can arise under bright 

25 lighting conditions. Here the sine function 

26 approaches the origin and no sine- function null can 
2 7 be found which corresponds to a desirable exposure 
28 setting. Without recourse to additional exposure 

2 9 control mechanisms such as LCD shutter or mechanical 

3 0 iris, a compromise must be sought between acceptable 
31 banding and acceptable exposure setting. 



The invention thus provides a technique for detection 
and frequency identification of flicker which 
operates in the time domain and which is applicable 
to both full -field exposure sensors and to rolling- 
window exposure sensors . 

Modifications and improvements may be made to the 
foregoing embodiment within the scope of the 
invention. 
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1 Claims 

2 

3 

4 1. A method of detecting lighting flicker in the 

5 output of a video imaging device, the video imaging 

6 device having a main picture area divided into pixels 

7 and producing successive images at a frame rate; the 

8 method comprising producing a series of signals from 

9 an additional picture area adjacent said main picture 

10 area, the additional picture area having a size 

11 substantially larger than a pixel, each of said 

12 signals being a function of light incident on the 

13 additional picture area in a time period 

14 substantially shorter than that of the frame rate; 

15 accumulating predetermined numbers of said signals. to. 

16 form a series of compound samples; and filtering the 

17 compound samples to detect components indicative of 

18 flicker. 
19 

20 2. The method of Claim 1, in which said time period 

21 is equivalent to the line rate of the main picture 

22 area. 
23 

24 3. The method of Claim 1 or 2 , in which said 

25 signals are derived from a plurality of additional 

2 6 picture areas. 
27 

28 4. The method of any preceding claim, in which said 

29 filtering is effected by a bandpass filter tuned to 

3 0 the nominal frequency of the flicker. 
31 
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5. The method of any of Claims 1 to 3 , in which 
said compound samples are formed at a sample rate 
which is a multiple of the nominal flicker frequency, 
and said filtering is effected by taking the 
fundamental output component of a radix-N butterfly. 

6. The method of Claim 5, in which N is 3 or 4 . 

7. The method of Claim 5 or Claim 6, in which said 
fundamental output component represents instantaneous 
complex flicker energy E, and in which E is averaged 
over time to produce a longer-term estimate E' of 
flicker energy. 

8. The method of Claim 7, in which E' is produced 
according to the relationship 

E' = E/x + E' (1 - fi) 

where \i is a time constant. 

9. The method of Claim 7 or Claim 8, further 
comprising deriving the modulus of E' and comparing 
this with a predetermined threshold T to give a final 
estimation of flicker being present if |E' |> T. 

10. A method of ameliorating lighting flicker in the 
output of a video imaging device; the method 
comprising detecting flicker by the method of any 
preceding claim and, during any time when flicker is 
detected, operating the main picture area of the 
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1 imaging device at an exposure setting selected to 

2 eliminate or minimise flicker. 
3 

4 11. The method of Claim 10, in which said exposure 

5 setting comprises an exposure period which is the 

6 inverse of the flicker frequency or a harmonic 

7 thereof . 
8 

9 12 . A flicker-detecting video camera comprising a 

10 video imaging device having a main picture area 

11 divided into pixels and producing successive images 

12 at a frame rate, and at least one additional picture 

13 area adjacent said main picture area and having a 

14 size substantially larger than a pixel, the 

15 additional picture area or areas being arranged to 

16 produce a series of signals each of which is a 

17 function of light incident on the additional picture 

18 area(s) in a time period substantially shorter than 

19 that of the frame rate; means for accumulating 

20 predetermined numbers of said signals to form a 

21 series of compound samples; and filter means for 

22 filtering the compound samples to detect components 

23 indicative of flicker. 
24 

25 13. The video camera of Claim 12, in which the or 

26 each additional picture area is a strip down one side 

27 of the main picture area. 
28 

29 14. The video camera of Claim 13, in which the or 

30 each additional picture area is formed by connecting 

31 a column of pixels in common. 
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15. The video camera of any of Claims 12 to 14, 
including gain control means for the additional 
picture area(s) independent of the gain control of 
the main picture area. 

16. The video camera of any of Claims 12 to 15, 
which the filter means comprises a radix-N butterfly. 

17. The video camera of Claim 16, further including 
an averaging circuit connected to the output of the 
radix-N butterfly. 

18. The video camera of Claim 17, in which the 
averaging circuit is a first -order autoregressive 
filter . 

19. The video camera of any of Claims 12 to 18, 
including an automatic exposure control circuit, a 
second exposure control circuit setting an exposure 
period which is the inverse of a known or anticipated 
flicker frequency or a harmonic thereof, and control 
means connecting the automatic exposure control 
circuit or the second exposure control circuit 
selectively to control exposure of the main picture 
area in dependence on the output of said filter 
means . 
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Figure 4: use of the method in a flicker-detecting video camera 
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Figure 2: compound sampling interval and aperture 




Figure 3: block diagram of flicker detection method 



